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(57) Digital video data encoder and decoder operate 
to enable the low and high speed reproduction of varia- 
ble rate encoded digital video data by reproducing and 
decoding intraframe encoded frames that are identified 
by previously reproduced intraframe encoded frames. 
In the encoder, digital video data is riable rate encoded 
(1 ), for example, intraframe and tnterf rame encoded, en- 
try points (i.e.. beginning positions) of selected encoded 
video data are identified and which represent video 
frames that occur at predetermined intervals of time (e. 
g., 1 , 2 and 4 seconds) in the video picture. Entry point 
data that identify these positions are generated (31 , 8. 



33) and added (32, 6) to the encoded video data before 
the video data is recorded on the record medium (DSM). 
When the encoded data is reproduced from the record 
medium, the entry point data is extracted therefrom and 
stored, and a successive intraframe encoded frame 
Identified by the extracted entry point data is reproduced 
and decoded. The inventkxi further provides for a record 
medium having thereon the encoded digital video data, 
and also provides for an encoder and corresponding de- 
coder which encode and decode, respectively, digital 
still image and audio data in which entry points refer to 
each of the still images and also to particular intervals 
of time of the audio data. 
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Description 

[0001 ] The invention relates to apparatus and method 
for encoding and decoding digital video data and to a 
record medium having stored thereon variable rate en- 
coded digital video data. 

[0002] An illustrative embodiment of the invention re- 
lates to apparatus and method for encoding and decod- 
ing digital video data which enable low and high-speed 
reproduction of variable rate encoded digital video data. 
[0003] An illustrative embodiment of the record medi- 
um stores the data in a particular data structure which 
enables the low and high speed reproduction thereof. 
[0004] As is known, MPEG compressed digital video 
data includes intraframe encoded digital video data ("I- 
frames*) and interframe encoded digital video data in- 
cluding forward predictive encoded data ("P-frames") 
and bi-directionally predictive encoded data ("B- 
frames"). Generally, an I -frame is decoded without using 
data of other frames, but P and B-f rames are decoded 
utilizing other frames. 

[0005] A bit stream of MPEG compressed digital vid- 
eo data generally is divided into groups of pictures 
(GOPs), and each GOP begins with an l-frame. When 
digital video data is MPEG compressed at a fixed rate, 
for example, when the frame pattern of the GOP is fixed, 
I -frames periodically occur In the bit stream at known 
positions thereof and, thus, high speed reproduction of 
the video data by reproducing only I -frames therein is 
possible since the general position of each l-frame is 
known. However, when digital video data is MPEG com- 
pressed at a variable rate (e.g., the frame pattern of a 
GOP is variable) l-frames do not occur in the bit stream 
at known Intervals thereof and, thus, high speed repro- 
duction by reproducing only l-frames is difficult. 
[0006] One technique for accomplishing higher than 
normal speed reproduction of MPEG compressed digit- 
al video data is to record in each sector that includes an 
l-frame at the beginning of a GOP therein a flag which 
indicates the existence of the l-frame, and to record in 
that sector the sector addresses (i.e., positions) of ad- 
jacent sectors that include l-frames therein. Therefore, 
a relatively slow search speed can be accomplished by 
reproducing adjacent 1 -pictures in the bit stream. 
[0007] One problem with the above-discussed tech- 
nique Is its general inability to reproduce video data from 
a record medium in high-speed searching modes 
wherein it is desirable to successively reproduce 1- 
frames occurring at relatively high intervals of time, for 
example, every 1, 2, 4, etc. seconds, in the bit stream. 
[0008] An embodiment of the invention seeks to pro- 
vide apparatus and method for encoding and decoding 
digital video data which overcome the shortcomings of 
the above-discussed reproducing technique. 
[0009] Another embodiment of the invention seeks to 
provide apparatus and method for encoding and decod- 
ing digital video data which is operable to achieve bw 
and high speed reproduction of compressed digital vid- 



eo data. 

[001 0] A further embodiment of the invention seeks to 
provide a recording and reproducing technique which 
operate to achieve both high and low speed reproduc- 

s tion of variable rate compressed digital video data. 
[0011] An additional embodiment of the invention 
seeks to provide a technique which allows for the repro- 
duction of l-frames temporally occurring at predeter- 
mined constant intervals of time. 

10 [0012] Still another embodiment of the invention 
seeks to provide a record medium having compressed 
digital video data stored thereon which is reproducible 
at low and high search speeds. 

[0013] A still further embodiment of the invention 
15 seeks to provide for the low and high speed reproduction 
of compressed digital still Image and audio data. 
[0014] In accordance with one aspect of the present 
invention, apparatus and method operate to variable 
rate encode digital video data, identify a selected plu- 
20 rality of entry points of the encoded video data which 
represent respective locatbns of video frames that oc- 
cur at predetermined intervals of time (eg. 1 , 2 and 4 
seconds) in the video picture, generate entry point data 
that identifies the positions of the entry points, add the 
25 entry point data to the encoded video data, and record 
the encoded video data having the entry point data add- 
ed thereto on a record medium. 

[0015] in an embodiment, the entry point data identi- 
fies entry points of intraframe encoded frames that occur 
30 at the predetermined intervals of time in the video pic- 
ture. 

[0016] In another embodiment, the entry point data 
identifies an entry point of the Intraframe encoded frame 
that is located nearest in time to the frame that occurs 

35 at one of the predetermined time intervals when that 
frame is not an intraframe encoded frame. 
[0017] In a further embodiment, respective entry point 
data is added to each intraframe encoded frame that 
identifies entry points of intraframe encoded frames that 

40 occur at predetermined intervals of time before and after 
the intraframe encoded frame to which the respective 
entry point data is added. 

[0018] In accordance with another aspect of the 
present invention, apparatus and method operate to re- 

45 produce from a record medium variable rate encoded 
digital video data which represents a plurality of succes- 
sive vkieo frames and which includes therein entry point 
data that identifies positions of entry points of the en- 
coded video data representing respective bcations of 

so video frames that occur at predetermined intervals of 
time In the video picture, extract the entry point data from 
the reproduced data, store the extracted entry point data 
In a memory, control the reproduction of the encoded 
data in accordance with entry point data that is stored 

55 in the memory so as to reproduce a particular video 
frame, and variable rate decode the reproduced data to 
produce decoded video data. 

[0019] In an embodiment, the reproduced data in- 
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used in an embodiment of the present Invention; 

Fig. 3 illustrates the data structure of an entry pack- 
et used in an embodiment of the present invention; 

5 

Fig. 4 is a schematic illustration of the location of I- 
frames and selected entry points thereof in the data 
stream temporally occurring at various intervals of 
time; 

10 

Fig. 5 is a flowchart of an illustrative method for de- 
tecting and recording the position of selected iden- 
tified frames in accordance with the present Inven- 
tion; 

IS 

Fig. 6 illustrates another data structure of a data 
pack used in an embodiment of the present inven- 
tion; 

20 Fig, 7 is a table of the program stream directory of 
an entry sector; 

Fig. 8 rs a table of the program stream map of an 
entry sector; 

2S 

Fig. 9 is a block diagram of another illustrative ap- 
paratus for encoding digital video data in accord- 
ance with the present invention; 

30 Ftg. 10 is a block diagram of illustrative apparatus 
for decoding digital video data in accordance with 
the present invention; 

Fig. 11 illustrates the data structure of entry point 
35 data; 

Fig. 12 is a block diagram of illustrative apparatus 
for decoding digital video data reproduced from ari 
illustrative record medium in accordance with the 
40 present invention; 

Fig. 1 3 Is a schematic illustration showing the loca- 
tions In a data stream of still image and audio data 
identified by entry point in accordance with illustra- 
45 tive embodiments of the present invention; and 

Fig. 14 is another schematice illustration showing 
the locations of audio data identified by entry point 
data. 

so 



eludes intraframe and interframe encoded frames and 
each reproduced intraframe encoded frame includes re- 
spective entry point data that identifies entry points of 
intraframe encoded frames that occur at the predeter- 
mined intervals of time from the intraframe encoded 
frame to which the respective entry point data is includ- 
ed. After the reproduction of one intraframe encoded 
frame, one of the intraframe encoded frames that is 
identified by the entry point data included in the repro- 
duced intraframe encoded frame then is reproduced. 
[0020] In accordance with a further aspect of the 
present invention, a record medium comprises a plural- 
ity of variable length video data areas in which variable 
encoded digital video data is stored, wherein the encod- 
ed digital video data Includes a plurality of Intraframe 
and interframe encoded frames each of which is stored 
in a respective one of the video data areas, and a plu- 
rality of entry point data areas in which entry point data 
are stored, wherein the entry point data identifies posi- 
tions of entry points of the encoded digital video data 
which represent respective locations of video data areas 
in which Intraframe encoded frames that occur at pre- 
determined intervals of time In the video picture are 
stored. 

[0021] In accordance with yet another aspect of the 
present Invention, apparatus and method operate to 
variable rate encode digital still image and audio data, 
identify entry points that represent locations of the still 
images in the encoded data, generate entry point data 
that Identifies positions of the identified entry points in 
the encoded data, add the entry point data to the encod- 
ed data, and record the encoded data having the entry 
point data added thereto on a record medium. 
[0022] In accordance with yet a further aspect of the 
present invention, apparatus and method operate to re- 
produce from a record medium variable rate encoded 
digital still image data that includes therein entry point 
data that kientifies positions of entry points of the en- 
coded data which represent respective locations of still 
images in the encoded data, extract the entry point data 
from the reproduced encoded data, store the extracted 
entry point data in a memory, control the reproduction 
of the encoded data in accordance with entry point data 
stored in the memory to reproduce an encoded still Im- 
age, and variable rate decode the reproduced encoded 
still Image to produce a decoded still image. 
[0023] The following detailed description, given by 
way of example and not Intended to limit the present in- 
vention solely thereto, will best be appreciated in con- 
junction with the accompanying drawings, wherein like 
reference numerals denote like elements and part, in 
which: 



[0024] Referring to the drawings, and particularly to 
Fig. 1 thereof, a block diagram of illustrative apparatus 
for encoding digital video data (hereinafter encoding ap- 
paratus) In accordance with the present invention is 
shown. The encoding apparatus is shown as comprising 
a video encoder 1 , and audk) encoder 2, a multiplexing 
circuit 3 and a digital storage menrK)ry (DSM) 10. A dig- 
ital video signal supplied to a video input terminal is sup- 



Fig. 1 Is a block diagram of illustrative apparatus for 
encoding digital video data in accordance with the ss 
present invention; 

Fig. 2 illustrates the data structure of a data pack 
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ptied to video encoder 1 which compression encodes (i. 
e., intratrame and interframe encodes) the video signal, 
in a manner well known in the art and which supplies 
the encoded video data to a video entry point detection 
circuit included in multiplexer 3. An digital audio signal 
supplied to an audio input terminal is supplied to audio 
encoder 2 which encodes the audio data therein in a 
manner well known in the art to produce packets of au- 
dio data and which supplies the packets of audio data 
to a code buffer 5 included in multiplexer 3. 
[0025] In accordance with one aspect of the present 
invention video encoder 1 supplies to a controller 8 an 
entry point ID signal at each output from the video en- 
coder of an 1 -frame (intracoded frame) of video data. 
[0026] Multiplexer 3 is comprised of code buffers 4 
and 5, a switching circuit 6, a header appending circuit 
1 , controller 8. a multiplex system clock generator 9, vid- 
eo entry point detection circuit 31 (hereinafter entry point 
detector 31), an entry sector generating circuit 32 and 
an entry point storage memory 33. Entry point detector 
31 detects the occurrence of an I -frame in the bit stream 
supplied thereto and supplies to controller 8 another en- 
try point ID signal which indicates the occurrence of an 
l-frame. Although the entry point ID signals supplied to 
controller 8 from both video encoder 1 and entry point 
detector 31 are redundant signals, under certain circum- 
stances, video encoder 1 will not generate the entry 
point ID signal, for example, as when pre-encoded video 
data is supplied thereto. Alternatively, video encoder 1 
does not supplies the entry point ID signal to control 8. 
in either case, the occurrence of each l-frame in the bit 
stream output from entry point detector 31 and which is 
supplied to code buffer 4 is known. 
[0027] Code buffer 4 stores the bit stream data sup- 
plied thereto and outputs the stored data to a terminal 
El of switch 6. Similarly, code buffer 5 stores the pack- 
ets of audio data therein and supplies the stored audio 
data to a terminal E2 of switch 6. Controller 8 functions 
to control switch 6 to switch between terminals E1 and 
E2 so as to time-divisionally multiplex packets of video 
and audio data. In addition, and in response to the oc- 
currence of an l-frame as indicated by an entry point ID 
signal from either circuit 1 or 31, controller 8 controls 
entry sector generating circuit 32 to generate entry 
packet data (to be discussed) and controls switch 6 to 
switch to terminal E3 so as to effectively insert the gen- 
erated entry packet data in the bit stream immediately 
prior to the l-frame. System clock generator 9 generates 
a system ckx:k signal which is supplied to controller 8 
whfch utilizes the supplied signal for purposes of con- 
trolling switch 6 to switch between its input terminals E1 
- E3. 

[0028] Switch 6 supplies the time-divisionally multi- 
plex data to header appending circuit 7 which, in re- 
sponse to a control signal from controller 8, adds a video 
packet header to the beginning of each packet of video 
data, adds an audio packet header to the beginning of 
each packet of audio data, and adds a pack header to 
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each data pack. Header appending circuit 7 further ap- 
pends a back header to each data pack so that each 
data pack is 2048 bytes long and supplies the resultant 
signal to digital storage memory DSM which stores the 

s digital data therein. 

[0029] Entry point storage memory 33 stores therein 
position data relating to the detected entry points, that 
is, positions of selected l-frames output from code buffer 
4. Entry point storage memory 33 is further discussed 

10 below. 

[0030] Fig. 2 illustrates the data structure of a data 
pack stored in DSM 10. As shown, the data pack in- 
cludes a pack header followed by a video packet header, 
video data, an entry packet, another video packet head- 

15 er, video data, an audio packet header and audio data. 
The pack header includes various information including 
a pack start code, SCR data, multiplexing rate data, etc. 
The first video packet header and video data immedi- 
ately following the pack header represent a packet of 

20 video data that does not include an l-frame therein since 
an entry packet has not been inserted before the first 
video packet header. However, an entry packet (also 
called entry data packet herein) precedes the next video 
packet header and, thus, the ensuing video data in- 

25 eludes an l-frame. 

[0031] The data structure of an entry packet is shown 
in Fig. 3. The entry packet includes a packet start code 
prefix followed by the stream ID data of Oxbf (hexadec- 
imal), length data which identifies the length (i.e., data 

30 amount) of the successive packet, "****" ID data (default 
is FFh) which indicates that the entry packet is specific 
for a particular person, "****■ packet type which indicates 
the type of classification if the entry packet is specific 
for a particular person, ••current# data streams" data 

35 which identifies the number of data sectors that occur 
before the next entry sector, "current# video streams" 
data which identifies the number of video sectors that 
occur before the next entry sector, and "current# audio 
streams" data which identifies the number of audio sec- 

40 tors that occur before the next entry sector. 

[0032] The entry packet further includes "-3", "-2", 
1 "+1 "+2" and "+3" entry packet data which identify 
the locations of 6 different "entry points" corresponding 
to the beginning positions of 6 different l-frames in the 

45 data stream. Referring to Fig. 4, a schematic illustration 
of successive l-frames in the encoded bit stream is 
shown (the P-frames and B-frames are not shown for 
convenience) wherein the entry packet stored with (i.e., 
immediately prior to) each l-frame identifies the ioca- 

so tions of 6 different l-frames. In accordance with the 
present invention, the "-3", "-2" and "-1 " entry packet da- 
ta identify the beginning locations of 3 l-frames that oc- 
cur at 3 different predetermined intervals of time prior to 
the l-frame in which the entry packet is stored. In addi- 

55 tion. the Vl ", °+2" and "+3° entry packet data identify 
the beginning locations of 3 l-frames that occur at the 3 
different predetermined intervals of time after the I- 
frame in which the entry packet is stored. If the 3 differ- 
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ent predetermined intervals of time are, for example. 1 
second. 2 seconds and 4 seconds, respectively, then 
the entry packet stored with I -frame 109 identifies the 
relative locations (relative to l-frame 109) of l-frames 
100, 103, 106. 112, 114 and 117. as shown in Fig. 4. As s 
seen, frame 100 occurs 4 seconds before l-frame 109, 
frame 103 occurs 2 seconds before l-frame 109, frame 
106 occurs 1 second before l-frame 109, l-frame 112 
occurs 1 second after l-frame 109, l-frame 114 occurs 
2 seconds after l-frame 109, and l-frame 117 occurs 4 io 
seconds after l-frame 109. Similarly, the entry packet 
stored with l-frame 110 identify l-frames 108, 105 and 
1 01 which occur 1 , 2 and 4 seconds, respectively, before 
l-frame 1 1 0, and also identify l-frames 113, 116 and 119 
which occur 1, 2 and 4 seconds, respectively, after I- is 
frame 110. Each of the entry packet data "-3", "-2", .... 
"+3" identifies the number of sectors between the cur- 
rent l-frame and the entry point (see Fig. 2) of the re- 
spective identified l-frame. The predetermined different 
intervals of time may be different from that shown in Fig. so 
4. For example, the intervals of time of 1 , 3 and 9 sec- 
onds may be used. Further, the intervals of time may be 
varied depending on various properties of the video pic- 
ture and may vary within the video picture itself. For ex- 
ample, time intervals may be relatively short for a group 25 
of images in which the motion therein is large and may 
be relatively large for a group of images if the motion 
therein is small. 

[0033] It is seen that by identifying entry points repre- 
senting l-frames located at 3 different intervals of time 30 
from a given l-frame (both before and after), both low- 
speed searching and high-speed searching (and mid- 
speed searching) can be accomplished, as will be dis- 
cussed. In addition, as the reproducing speed exponen- 
tially increases, for example, from a 1 0x to a lOOx re- -35 
producing speed, it is preferable to use entry points (i. 
e.. l-frames) that are located at exponentially increasing 
temporal. distances from a given l-frame. For example, 
in a 100x reproducing nrKxJe. a predetermined time in- 
terval of approximately 4 seconds is chosen. At a 30 40 
frame/second frame rate, there are 120 frames in 4 sec- 
onds, which is close enough to the desired lOOx repro- 
ducing speed. However, a 3.3 second time interval can 
be used if greater precision is required. On the other 
hand, for very low reproducing search speeds, for ex- 4S 
ample, in a 2x reproducing mode, sequential decoding 
of l-frames should suffice and, thus, use of entry points 
may not be necessary. 

[0034] Referring back to Fig. 1, an entry sector (i.e.. 
entry packet), which includes the data shown in Fig. 3. so 
is generated by entry sector generator 32 in response 
to the occurrence of an f-frame (i.e. . current l-frame), as 
previously discussed. At the time the entry packet is 
generated, the entry packet data -3, -2 and -1 can be 
generated since the positions of l-frames that precede ss 
the current frame are known (i.e.. they have already oc- 
curred in the bit stream). Entry point storage memory 33 
stores the absolute positions of each entry point (i.e., 



8 

the beginning of each l-frame) in the bit stream, and en- 
try sector generator 32 is operable to generate relative 
position data identifying the 3 l-frames that occur before 
the current frame by using the absolute position of those 
l-frames stored in memory 33 and the known position of 
the current frame. 

[0035] However, the position of entry points corre- 
sponding to the beginning locations of l-frames that oc- 
cur after the current frame are not known at the time the 
current frame is supplied to switch 6 (i.e.. when it occurs 
in the bit stream). Thus, dummy data is established as 
entry packet data +1 , +2 and +3 in entry sector gener- 
ator 32 and the bit stream including the video and audio 
data and each of the entry packets (having the dummy 
data therein) is stored in DSi\/l 10. At the end of the bit 
stream (i.e., after all of the video, audio and entry pack- 
ets are stored in DSM 10), controller 8 ascertains the 
values of entry packet data +1 , +2 and +3 for every one 
of the entry packets using the positions of each of the 
entry points (i.e., l-frames) stored in memory 33, and 
stores the entry packet data -i-l , +2 and +3 of every entry 
packet in the appropriate location of DSM 10. 
[0036] As previously mentioned, the digital video data 
may be variable-bit encoded (e.g., the frame pattern of 
a GOP is variable). In this case, an l-frame may not oc- 
cur at constant intervals in the bit stream and, thus, if a -'V 
desired interval of time is, for example. 1 second, the ' 
encoding apparatus of the present invention cannot as- 
sume that the same number of frames (I, P and B- • 
frames) occur between l-frames that are approximately 
1 second apart from one another. It is therefore neces- 
sary to ensure that each l-frame to which entry packet 
data of a current frame refers is as closest to the desired ' 
time interval as possible. 

[0037] Fig. 5 is a flowchart of an operation of controller 
8 for identifying the appropriate l-frame to which each 
entry packet data refers in accordance with the present-^^ 
embodiment. It is noted that controller 8 operates to ex-' 
ecute the flowchart of Fig. 5 twice, once when the bit 
stream is being output from video encoder 1 and sub- 
sequently stored in DSM 10 to ascertain the positions 
of the entry points of l-frames that precede the current 
frame, and a second time after the bit stream is fully 
stored in DSM 10 so as to ascertain the positions of the 
entry points of l-frames that follow each current frame. 
[0038] A description of the first time execution of the 
flowchart of Fig. 5 will be provided. At the occurrence of 
an l-frame (i.e., current frame), the position (PCT) of a 
selected frame that precedes the current frame by 30 
frames, which corresponds to a frame that occurs 1 sec- 
ond before the current frame, is ascertained at instruc- 
tion SI 01. Since entry points should refer only to I- 
frames, inquiry SI 02 determines whether the selected 
frame is an l-frame. If the selected frame is an i -frame, 
the beginning position (i.e., the entry point) of the se- 
lected frame relative to the current frame is stored as 
the entry packet data -1 of the entry packet that is stored 
with (i.e., immediately preceding) the current frame at 
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instruction SI 04. However, if the selected frame is not 
an i -frame, the position of a frame that Is adjacent to 
(either before or after) the selected frame In the bit 
stream Is selected as the new selected frame at instruc- 
tion S103, and then it is determined if the new selected 
frame is an l-frame at inquiry S102. The result of steps 
of S102 and S103 Is a selection of an l-frame that is 
closest in time to the desired 1 second time Interval from 
the current frame. 

[0039] Next, the position (PCT) of a selected second 
frame that precedes the current frame by 60 frames, 
which corresponds to a frame that occurs 2 seconds be- 
fore the current frame, is ascertained at instruction 
S105. Similar to Inquiry S102 and instruction S103, in- 
quiry SI 06 determines whether the selected second 
frame Is an l-frame, and the position of a frame that is 
adjacent to the selected second frame in the bit stream 
is selected as the new selected second frame at instruc- 
tion SI 07. When the selected second frame is an I- 
frame, the beginning position of the selected second 
frame relative to the current frame is stored as the entry 
packet data -2 of the entry packet of the current frame 
at instruction S108. 

[0040] Steps 109 through 112 operate In a similar 
fashion to both sets of steps SI 01 to SI 04 and steps 
SI 05 to Si 08, except that an l-frame that precedes the 
current frame by 120 frames initially is selected, which 
corresponds to a frame that occurs approximately 4 sec- 
onds before the current frame. The beginning position 
of the selected third frame relative to the current frame 
then is stored as the entry packet data -3 of the entry 
packet of the current frame at instruction S112. 
[0041] The operation of the flowchart of Fig. 5 is re- 
peated after the entire bit stream Is stored in DSM 10 to 
ascertain the positions of the entry points of l-frames 
that occur after the current frames. 
[0042] Although the flowchart of Fig. 5 provides for the 
re-selecting of a frame, in inquiries SI 03, SI 07 and 
8111, if an l-frame has not yet been selected, the 
present invention contemplates that the ultimate selec- 
tion of an l-frame that occurs at a time inten/al from a 
current frame that is considerably different from a de- 
sired time Interval may be undesirable. Therefore, in one 
embodiment of the present invention, l-frames that oc- 
cur before or after the current l-frame by an amount of 
time that Is different from the desired time Interval by 
more than 1 0% are not referred to by the entry point data 
of the current l-frame. For example, for the desired time 
Intervals of 1 , 3 and 9 seconds, l-frames that occur at 
times less than 900 milliseconds (ms), 2700 ms and 
9000 ms from the current l-frame are not referred to in 
entry packet data of the current frame. 
[0043] If the next entry point is the first I -picture of a 
GOP, the beginning of the GOP Is detected by the group 
start code Included in the GOP. An l-frame which ap- 
pears first becomes the next entry point. 
[0044] Fig. 6 illustrates the data structure of the entry 
sector, that is. a data pack in which an l-frame is includ- 



ed, in accordance with another illustrative embodiment 
of the present invention. As shown, the entry sector in- 
cludes a pack header which includes therein a pack start 
code, SCR data and MUX rate data. The pack header 
s Is followed by a program stream directory, a program 
stream map, a pack other than a video pack, a video 
packet header, video data including an l-frame, an audio 
packet header, and audio data. In this embodiment, the 
data occurs in a pre-set sequence from the beginning 
10 of the sector, thus facilitating data handling. 

[0045] The program stream di rectory has a data struc- 
ture defined by the MPEG standard and Is used to spec- 
ify an accessible position in the data stream. The pro- 
gram stream directory is shown in Fig. 7. A loop "A" in 
^5 the stream is traversed seven times to record three "for- 
ward" and three "backward" l-frames as well as the entry 
points to the "backward" l-frames. "Forward" and "back- 
ward" l-frames herein refer to the l-frames that are iden- 
tified in the data pack of a current frame. The program 
20 stream map is shown in Fig, 8 and, as shown, loops B 
and C therein include descriptors "()" for accommodat- 
ing a variety of Information data. Information data are 
included in the descriptors, for example, the number of 
streams or the information on elementary streams. 
25 [0046] Fig. 9 is a block diagram of apparatus for en- 
coding digital video data in accordance with another il- 
lustrative embodiment of the present invention, wherein 
a map information storage device 35 is included in mul- 
tiplexer 3 which receives information from an external 
30 entry device (not shown). All elements of the apparatus 
of Fig. 9, except device 35, are included In the encoding 
apparatus of Fig. 1 and, therefore, description thereof is 
omitted herein. Information stored In device 35 is read 
therefrom and stored as an entry sector each time It con- 
35 stitutes an entry sector. If the Information utilizes a future 
entry sector position, the entry sector position is read 
from device 33 after the entire bit stream Is stored in 
DSM 10. 

[0047] Fig. 10 is a block diagram of Illustrative appa- 
40 ratus for decoding digital video data in accordance with 
the present invention. The decoding apparatus of Fig. 
10 decodes data stored in DSM 10 having the data 
structure shown In Fig. 2. The decoding apparatus is 
comprised of a separation device 21, a video decoder 
^5 25 and an audio decoder 26. In response to control sig- 
nals supplied from a controller 24, the encoded digital 
data is read from DSM 1 0 and supplied to a header sep- 
aration circuit 22 which separates each pack header, 
each packet header and each entry packet from the read 
50 out data and supplies the separated data to controller 
24. Header separation circuit 22 also supplies the time- 
divisionally multiplexed data to an input terminal G of a 
switching circuit 23 which demultiplexes the data (in re- 
sponse to a control signal from controller 24) by supply- 
55 jng video data therein to a terminal HI and supplying 
audio data therein to a terminal H2. The video data is 
supplied to video decoder 25 and the audio data Is sup- 
plied to audio decoder 26 which decode the respective 
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data in manners well known in the art. 

[0048] Controller 24 supplies the entry packet data to 

entry point storage devk:e 24 whk^h stores the supplied 

data therein. DSM 10 supplies to controller 24 readout 

position informatbn Identifying the positbn in the bit 

stream of that data supplied to header separation circuit 

24. 

[0049] The operation of the decoding apparatus of 
Fig. 10 operating in a search mode will now be de- 
scribed. A main controller (not shown) supplies appro- 
priate control signals to controller 24, video decoder 25 
and audio decoder 26 so that they operate in a particular 
search mo6e. Upon reproduction in the search mode, 
controller 24 controls DSM 10 to read out the closest I- 
frame identified by the data stored in device 41 , if avail- 
able. All of the entry points may be pre-stored (e.g., upon 
power-up) in device 41 (by reproducing the entire bit 
stream) prior to reproducing in the search mode. As pre- 
viously discussed, an entry packet is located immedi- 
ately before each l-frame and, thus, an l-frame is read- 
ably obtained. 

[0050] DSM 10 reads out the l-frame including the en- 
try packet that is stored immediately therebefore. Sep- 
aration device 21 along with video decoder 25 operate 
to decode the l-frame and supply the decoded image 
data at the video output terminal. While the decoding 
apparatus is in the search mode, the output of audio de- 
coder 26 is muted. While decoding the read out l-frame, 
controller 24 ascertains the position in DSM 1 0 of the 
next l-frame to be read out. As previously discussed, the 
entry packet includes therein the positions of 6 different 
l-frames relative to the position of the currently read out 
l-frame, and depending on which search mode is select- 
ed, the position of one of those 6 different l-frames Is 
ascertained in controller 24. 

[0051] In a low speed forward search mode, the po- 
sition of the next l-frame to be reproduced is stored in 
entry packet data +1 . In a high speed forward search 
mode, the position of the next l-frame to be reproduced 
is stored in entry packet data +3. In addition, low, medi- 
um and high reverse search speeds can be accom- 
plished since the position of the next l-frame to be re- 
produced is stored in entry packet data -1 , -2, and -3 
respectively. Fig. 11 illustrates the data structure of an 
entry packet reproduced from DSM 10 in accordance 
with another illustrative embodiment of the present in- 
vention. 

[0052] Referring next to Fig. 12. a block diagram of 
illustrative apparatus for decoding digital video data re- 
produced from an optical disk in accordance with anoth- 
er embodiment of the present invention is shown. Digital 
data is picked up from an optical disk 60 by pickup de- 
vice 61 in response to a control signal supplied from a 
tracking servo device 70. A controller 67 supplies a con- 
trol command to a drive control circuit 69 which produc- 
es a drive signal and which supplies the drive signal to 
tracking servo device 70. A data pack is read from the 
optical disk and supplied to demodulation circuit 62 



12 

which demodulates the signal and supplies a demodu- 
lated signal to ECC circuit 63 which detects and corrects 
errors in the supplied signal. The signal then is supplied 
to demultiplexer 64 which supplies video data therein to 

s a video decoder 65. supplies audio data therein to an 
audio decoder 66 and supplies TOG information to con- 
troller 67. TOC information generally is stored in the first 
reproduced sector. Controller 67 supplies the TOC in- 
formation to TOC storage device 68 which stores the 

10 TOC information therein. Further, controller 67 causes 
a display (not shown) to indicate to a user that the TOC 
data is loaded. 

[0053] When the reproducing device shown in Fig. 1 2 
begins reproducing video data (in response to an appro- 

'5 priate control signal), drive controller 69 drives via track- 
ing servo circuit 70 the pickup device 61 to reproduce 
data from disk 60 at a position indicated by the user. At 
the same time, controller 67 controls video decoder 65 
and audio decoder 66 to prepare for decoding. 

20 [0054] Data is reproduced from disk 60 in a manner 
well known in the art and the reproduced data is demod- 
ulated in circuit 62 and supplied to ECC circuit 63 which 
corrects errors therein. The error corrected data is sup- 
plied to demultiplexer 64 which, as previously stated, 

25 demultiplexes the data and supplies the video and audio s • 
data therein to video and audio decoders 65 and 66 a 
which decode and output the respectively supplied data.* 
[0055] In addition, demodulation circuit 62 supplies 
the demodulated reproduced data to an entry point de- 

30 tection circuit 90 which extracts entry point data (e.g., 
an entry packet) therefrom and supplies the extracted 
data to subcode CRC circuit 91 which corrects errors 
therein. The positions of the entry points of the l-frames 
Identified in the entry point data are stored In entry point ' 

35 buffer 92. 

[0056] Controller 67 reads out the data of the next en- ' 
try point from the entry point buffer 92 and supplies the 
read-out information to an entry point storage device 93 
which stores the data therein. Controller 92 is supplied 
40 with the information on the current read-out position 
from drive controller 69 and, thus, the position and con- 
tents of the next entry points can be assoctatively stored 
in device 93. 

[0057] The operation of the reproducing and decoding 
45 apparatus of Fig. 1 2 operating in a search mode will now 
be described. Controller 67 controls video decoder 65 
and audio decoder 66 so that they operate in a particular 
search mode. Upon reproduction in the search mode, 
controller 67 controls drive control 69 to cause pk:kup 
so device 61 to read out the entry point that is located near 
the current read out position, as identified in device 93. 
Pickup device 61 reproduces data from the entry point 
and supplies via the various circuits the reproduced data 
to demultiplexer 64. Demultiplexer 64 supplies the video 
55 data to video decoder 65 which decodes and outputs 
the supplied data. While the reproducing and decoding 
apparatus of fig. 1 2 is in the search mode, the output of 
audio decoder 66 is muted. 
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[0058] The entry point portions are separated from the 
data by entry point detection circuit 90 and stored in the 
entry point buffer 92 for retrieval by controller 67. As pre- 
viously mentioned, since reproduction begins at the en- 
try point, the ensuing video data is an l-frame which is 
quickly decoded and output. 

[0059] As previously discussed, the entry packet in- 
cludes therein the positions of 6 different l-frames rela- 
tive to the position of the currently read out frame, and 
depending on the search mode, the position of one of 
the 6 l-trames is ascertained in controller 24. This oper- 
ation is similar to that described above with reference to 
Fig. 10. 

[0060] In the above discussed illustrative embodi- 
ments, both motion video and audio data are included 
in the bit stream. The present invention, however, is not 
limited to motion video and audio data and may involve 
a bit stream including still image and audio data or in- 
cluding only audio data. Fig. 1 3 is a schematic illustra- 
tion showing the locations in a data stream of still image 
and audio data identified by entry point data in accord- 
ance with the present invention. Two different entry 
points A and B identify the locations of the beginning of 
still image data and audio data, respectively An entry 
packet (A) is stored immediately prior to each still image, 
whereas an entry packet (B) is stored before predeter- 
mined temporal intervals of audio data in the bit stream. 
For example, entry sectors B are inserted in the bit 
stream representing audio intervals of time of 450 to 
550ms. Alternatively, if entry sectors A are present at an 
interval equal to the interval of entry sectors B, entry sec- 
tors B may be omitted. 

[0061] Entry sector A has program stream directory 
data composed of three entries which specify an imme- 
diately previous still image, an immediately succeeding 
still image and the next succeeding still image, respec- 
tively. If the immediately previous still image and the 
next following still image are not present, zeros are re- 
corded in the program stream directory data. The imme- 
diately succeeding still image cannot be absent, so that 
an offset is necessarily recorded. On the other hand, the 
entry sector B has program stream directory data made 
up of two entries which denote the directly previous still 
image and the next following still Image. 
[0062] The above -discussed embodiment, wherein 
audio still image and audio data are transmitted in a bit 
stream, may be encoded by the encoding apparatus 
shown in Fig. 1 , previously discussed. However, each 
still image in this embodiment is treated as an l-frame 
in the apparatus of Fig. 1 . 

[0063] Referring back to Fig. 1, controller 8 receives 
an entry point generating signal from video encoder 1 
or from video entry point detection circuit 31 and causes 
an entry sector A of the type corresponding to the still 
image to be generated and stored directly ahead of the 
still image in the bit stream. 

[0064] If 450 to 550 milliseconds have elapsed with- 
out the generation of an entry point by generating sector 



32, an entry sector B that is not associated with a still 
image is generated and multiplexed onto the bit stream. 
The number of entries contained in the program stream 
directory data at this time becomes different. 

5 [0065] Entry sector A includes therein the positions of 
three entry sectors immediately preceding data of 3 still 
Images, respectively. The positions correspond to a pre- 
ceding still image to the current image and the two suc- 
ceeding still images. However, entry sector A of the type 

10 not corresponding to the still image include the positions 
of two entry sectors that precede 2 still images, one still 
image being before the current Image and one still im- 
age being after the current image. This data is stored as 
the program stream directory data. 

IS [0066] Similar to the positions of l-frames, previously 
discussed, the position of preceding entry sector posi- 
tions are known and, thus, can be stored in storage de- 
vice 33. However, the following entry sector positions 
are known. Thus, all entry point positions are stored in 

20 storage device 33 and after the entire bit stream is 
stored in DSM 10, the positions of the entry sectors of 
the next entry points directly previous and directly sub- 
sequent to each entry sector are read out and supplied 
to the DSM 10 for recording thereon. 

25 [0067] Since relatively few still images are recorded 
on a record medium. It is necessary for a reproducing 
apparatus to be able to readily identify the locations at 
which the images are recorded. For example, if repro- 
duction begins at position P2 of Fig. 1 3, and the asso- 

30 ciated video image for the audio data stored at P2 is at 
position PI, it is necessary for the reproducing appara- 
tus to access position PI so as to read out the still image 
data and then return to position P2 to reproduce the au- 
dio data. 

35 [0068] At this time, the reproducing apparatus is op- 
erated in such a manner that it searches the closest en- 
try sector from a position designated for starting the re- 
production. The entry sector begins with a pack header 
followed directly by program stream directory data, as 

40 shown in Fig. 6. The reproducing apparatus inspects the 
data contents from the position designated for reproduc- 
tion and when a coincidence of the entry sector features 
is noticed, it causes the contents of the entry sector to 
be read out. The reproducing apparatus then comes to 

45 a halt. 

[0069] If there are three PSD entries, there is a still 
image directly at back, so that reproduction is continued. 
If there are two PSD entries, the associated still image 
is present in the past, so that it is necessary to read and 

so decode the associated still image. The reproducing ap- 
paratus accesses using the directly previous still image 
from the read-out PSD. In the example of Fig. 1 3, the 
reproducing apparatus jumps from position P2 to posi- 
tion PI . The reproducing apparatus reads out, decodes 

55 and stores the corresponding still Image before revert- 
ing back to the position P2 for starting the audio decod- 
ing. In this manner, correctly associated reproduction 
may be achieved in a stream containing both still image 
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and audio data. 

[0070] Special reproduction on the still image is ac- 
complished by utilizing the positions of previous still im- 
ages and subsequent stil! Images recorded in each entry 
sector. That is, in a special forward reproduction mode, 
the reproducing apparatus jumps to the position of the 
directly succeeding still Image identified as the PSD da- 
ta that is recorded in each entry sector. In a special re- 
verse reproduction mode, the apparatus jumps to the 
position of the directly previous still image. 
[0071] Fig. 14 schematically illustrates a bit stream in- 
cluding only audio data. Audio entry sectors B are stored 
at inten/als of 450 to 550 milliseconds in the audio data 
stream. The entry sector Includes program stream di- 
rectory data, but no video data is specified therein. Thus, 
the presence of program stream directory data specifies 
only the fact that the sector is an entry sector. Playback 
start enabling points are present substantially every 
sector. Thus, there is no meaning in recording the entry 
points and, hence, there is no PSD entry. However, the 
information of program stream map data is required for 
comprehending the stream status. Therefore, reproduc- 
tion begins In general at an entry sector and reproduc- 
tion begins after acquiring the information on program 
stream map data. 

[0072] While the present Invention has been particu- 
larly shown and described in conjunction with preferred 
illustrative embodiments thereof, It will be readily appre- 
ciated by those of ordinary skill in the art that various 
changes may be made without departing from the spirit 
and scope of the invention. For example, although the 
time intervals of 1 , 2 and 4 seconds, and 1 , 3 and 9 sec- 
onds is disclosed herein, other time Intervals and other 
number of time Intervals, eg. 4 different time intervals 
may be used in the present invention. 
[0073] Therefore, it is intended that the appended 
claims be interpreted as including the embodiments de- 
scribed herein, the alternatives mentioned above, and 
alt equivalents thereto. 



Claims 

1 . Apparatus for encoding digital still image and audio 
data, comprising: 

means for variable rate encoding the digital still 
image and audio data to produce variable rate 
encoded data; 

means for identifying entry points representing 
locations of the still images in said encoded da- 
ta; 

means for generating entry point data identify- 
ing positions of the identified entry points in said 
encoded data; 

means for adding the generated entry point da- 
ta to said encoded data; and 
means for recording the encoded data having 



the generated entry point data added thereto 
on a record medium. 

2. The apparatus of claim 1 , wherein said means for 
5 identifying is operable to identify audio entry points 

in said encoded data representing locations of au- 
dio data occurring at predetermined intervals of 
time; said means for generating Is operable to gen- 
erate audio entry point data identifying positions of 
10 the identified audio entry points in said encoded da- 
ta; and said means for adding is operable to add the 
generated audio entry point data to said encoded 
data. 

IS 3. Method of encoding digital still image and audio da- 
ta, comprising the steps of: 

variable rate encoding the digital still image and 
audio data to produce variable rate encoded 

20 data; 

identifying entry points representing locations 
of the still Images in the encoded data; 
generating entry point data identifying positions 
of the identified entry points in the encoded da- 

2S ta; 

adding the generated entry point data to the en- • 
coded data; and 

recording the encoded data having the gener- 
ated entry point data added thereto on a record 
30 medium. ' 

4. The method of claim 3, wherein said step of identi- 
fying is carried out by identifying audio entry points 
in the encoded data representing locations of audio 

35 data occurring at predetermined Intervals of time; 

said step of generating is carried out by generating - 
audio entry point data identifying positions of thef 
kjentified audio entry points in the encoded data;' 
and said step of adding is carried out by adding the 

"to generated audio entry point data to said encoded 
data. 

5. Apparatus for decoding variable rate encoded dig- 
ital still image data, comprising: 

45 

reproducing means for reproducing from a 
record medium variable rate encoded digital 
still image data and including therein entry point 
data Identifying positions of entry points of the 

so encoded data representing respective loca- 

tions of still images In the encoded data; 
means for extracting the entry point data from 
the reproduced encoded data; 
storage means for storing the extracted entry 

55 point data; 

control means for controlling said reproducing 
means to reproduce an encoded still image in 
accordance with entry point data stored in the 
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storag9 means; and 

means for variable rate decoding the repro- 
duced encoded still image to produce a decod- 
ed stiil Image. 

5 

6. Method of decoding variable rate encoded digital 
still image data, comprising the steps of: 

reproducing from a record medium variable 
rate encoded digital still image data and includ- io 
ing therein entry point data identifying positions 
of entry points of the encoded data represent- 
ing respective locations of still images in the en- 
coded data; 

extracting the entry point data from the repro- is 
duced encoded data; 

storing the extracted entry point data in a mem- 
ory; 

controlling the reproducing of the encoded data 
in accordance with entry point data stored in the 20 
memory to reproduce an encoded still image; 
and 

variable rate decoding the reproduced encoded 
still image to produce a decoded still image. 

25 
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Syntax No. of bits Mnemonic 



directory_PES_packetO { 



nackAt ^tart cofle nrefiy 


24 


bslbf 


directory stream id 


8 


uimsbf 




16 


UlllloDI 


number of access units 


15 


uimsbf 


marker bit 


1 


bslbf 


prev directory offset[44..30] 


15 


uimsbf 


marker bit 


1 


bslbf 




15 


1 li mcKf 

Ull 1 loLI 1 


marker bit 

III u t rV W 1 1 & 




bslbf 




1 c 
1 9 


UilllOUl 


marker bit 


1 


bslbf 




1 5 




marlcer bit 


1 


bslbf 


next directorv off setr29 1 51 


1 5 


uimsbf 


markpr bit 


1 


bslbf 


next_di recto ry_offset[14..0] 


15 


uimsbf 


marker bit 




bslbf 


for(i=0; i<number of access units; i4-f} { 






pawwci oil tJdi II lU 


8 


uimcbf 

UIIIIOI^I 


PES header oosition off<^et <ian 


1 


tcimsbf 


PP^ bP^ifiAi* oncitinn offcotfA^ ^Hl 


14 




marker bit 


1 


bslbf 


PPI^ hoa#4or nncitinn nffoAtfOQ 1 CI 
V cw iicowsr _ |j»Joiiiwii_tJnod|jssy«« ■ 


15 


uimsbf 


marker bit 


1 


bslbf 


PP^ HaoHat nncitl/^n offcAtT'lA m 

r CO 1 iCdUcr |JUolLIUil 1 1 OtSl^ 1 


15 


uimsbf 

UllllOiJI 


mfirkAr bit 




bslbf 


reference offset 


16 


uimsbf 


rnaiivBi oil 


1 
• 


bslbf 


reserved 


3 


bslbf 


PTS[32..30] 


3 


uimsbf 


marker_bit 


1 


bslbf 


PTS[29..15] 


15 


uimsbf 


marker bit 


1 


bslbf 


PTS[14,.0] 


15 


uimsbf 


marker_bit 


1 


bslbf 


bytes_to_read[22..8] 


15 


uimsbf 


marker_bit 


1 


bslbf 


bytes_to_read[7..0] 


8 


uimsbf 


marker.bit 


1 


bslbf 


intra.codedjndicator 


1 


bslbf 


coding.parametersJ ndicator 


2 


bslbf 


reserved 


4 


bslbf 



1 
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Syntax 



No. of Bits Mnemonic 



program_stream_map(){ 

packet_start_code_prefix 24 bslbf 

map_streamjd 8 uimsbf 

program_stream_map_length 1 6 uimsbf 

current_next_indicator 1 bslbf 

reserved 2 bslbf 

program_stream_map_version 5 uimsbf 

reserved 7 bslbf 

marker^bit 1 bslbf 

program_stream_info Jength 1 6 uimsbf 

for (i=0;i<N;i++){ 

descriptorO 

} 

elementary _stream_mapjength 1 6 uimsbf 

for (i=0;i<N1;i++){ 

stream_type 8 uimsbf 

elementary_streamjd 8 uimsbf 

e!ementary_streamJnfo Jength 1 6 uimsbf 
for(i=0;i<N2;i++){ 

descriptorO 

} 

} 

CRCJ2 32 rpchof 

} 
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(54) Apparatus and method for encoding and decoding digital video data 

(57) Digital video data encoder and decoder operate 
to enable the low and high speed reproduction of varia- 
ble rate encoded digital video data by reproducing and 
decoding intraf rame encoded frames that are identified 
by previously reproduced intraframe encoded frames. 
In the encoder, digital video data is riable rate encoded 
(1 ). for example, intraframe and interframe encoded, en- 
try points (i.e. , beginning positions) of selected encoded 
video data are identified and which represent video 
frames that occur at predetermined intervals of time (e. 
g., 1 , 2 and 4 seconds) in the video picture. Entry point 
data that identify these positions are generated (31 , 8. 
33) and added (32. 6) to the encoded video data before 
the video data is recorded on the record medium (DSM). 
When the encoded data is reproduced from the record 

medium, the entry point data is extracted therefrom and 

stored, and a successive intraframe encoded frame 

identified by the extracted entry point data is reproduced 

and decoded. The invention further provides for a record 

medium having thereon the encoded digital video data. 

and also provides for an encoder and corresponding de- 
coder which encode and decode, respectively, digital 

still image and audio data in which entry points refer to 

each of the still images and also to particular inten/als 

of time of the audio data 
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